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Alumni Perceptions: A ^est of NCHEMS' Gutcoraes Structure 



Abstract 



were 



re 



H tneor.tical taxonomy of student outcomes from NCHEMS is investigated 
using responses from 1.833 aiumni of a comprehensive state university. The 
alumni spanned 45 class .ears and four major curricular types. Six factors 

retav-.ed which suppo, ted the wo. k by NCHEMS while demonstrating a needed 
finement in the sociai/cultural/per sonal area. MANOVA showed great 
stability of outcomes with no significant time X carr.culum interaction. 
There were smooth trends on two ^significant discriminant functions for the 
effect of time: Two significant discriminant functions for curricula showed 
that those in various fields felt they received relatively more benefits in 
expected areas. 



of-outcome subcategories" which replaced his first taxonbrny with indicators of 
Sutcomes falling into these categories; Economi-; Human Characteristics; 
Knowledge. Technology, and Art Form; Desources ind Service provisior,; an^ 
Other Maintenance and Change Outcomes. These later five dimensions have a 
four-digit identifier and are proposed as outcome categories to replace his 
original taxonomy. Consequently, an opportunity existed to assess the outlook 
and outcomes of the alumni of a university and to review the outcomes 
structure proposed by Lenning. 
Procedure 

The investigation of outcomes, therefore, became a part of a much larger 
opinion survey of U . 082 former students using subsamples of classes at every 
fifth year from 1931 to 1976. The subsamples were the smaller ^f a random 
sample of 500 or the total graduating class. Only alumni were surveyed for 
whom there was a mailing address. 

For the purpose of analyses, respondents were divided into ctirricular 
groups: applied science ( agr i cul tur p , architecture, biology, computer 
science, mathematical sciences, and natural sciences), business, engineering, 
or qualitative studies:^ eiass year served as another grouping over time or by 
graduation group. Group 1 (1931-1945). Group 2 (1951-1956). Group 3 (1961). 
Group M (1966-1971) and Group 5 (1976). These classifications coincided with _ 
certain historial events: WW II era (Group 1). the Korean War era (Group 2). 
the growth of the institution {movement away from a polytechnic institution} 
(Group 3). emergence as a university (GroUp M). and university status (Group 

5) : 



^These groupings were selected to be similar to those established by 
Biglan (1973) but were brought to a higher level of aggregation to give a m-M 
balanced cell size over the time covered by the alumni surveyed; 
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In the qaestionnair-e alurr:.v. were asked to coSSent on sixteen possible 
educational outcomes which had been extracted from the writings of Lenning 
(1975, 1977) and Bbwen (1977): The sixteen outcomes appear in Table 1: 

1 

Table 1 about here 

Responses of the alumni to the outcomes Were factor analyzed. This technique 
allowed for development of dimension :.cores to test the trends over time, the 
differences by curricula group, and the possible interaction of curricula 
group over the time.groups. Since such methodology traditionally produces 
correlated measures, the test for differences was undertaken using 
multivariate analysis of variance with discriminant analysis on the dispersion 
matrix for each treatment tested (Clyde, 1969). 

Intercorrelations between tn-e items were computed and principal 
components were extracted. The eigenvalues indica.zd the possible use of a 5. 
6. or 7 factor solution (values of .81, .77 and .72 respectively, accounting 
for 66%, 71%, and 75% of the cumulative variance). This finding caused 
varimax rotations to be performed, and the 5,factor solution was selected 
because of the relative drop in eigenvalues, the satisfactory communal ities 
(maximum of .85, n.inimum of .60, With a median of .70), and the degree to 
which simple structure was obtained after rotation.-^ 



^The five factor solution had a median communality of .66 but h,-d 

numerous overlapping interns for both or thogonal_ and oblique (Promax) rotations. 
The seven factor solution had a median communality of .71 and was similar to 
tfte Six factor solution with an additional factor which was a doublet formed 
by the two items which contained the word "clarification." 
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Fihdings 

The loadings of the sixteen outcomes after a varimax rotation for six 
factors are shown in Table 1. Dimension scores are formed as average item 
scores usinp the items as .^oted in Table The means for the six dimensions 
are shown by Curriculum Group (Table 2) and by Graduation Group (Table 3). 

Tables 2 and 3 about here 

There proved to be a lack of significant interaction between Curriculam 
and Graduation Group (F = 1.181. df . 72. 8896; p > -D based on the ..ores oi 
these six dimensions. Significant differences exist, between the va-^ious 
combinations of the Graduation Groups (F . 6.82. of = 2-4. 5761; p < -ODI) and 
also Curriculum Groups (F -- 19.74. df -- 18.^622; p < .001). The standardized 
discriminant function coefficients for the significant functions from both 
analyses are shown in Table M . The centroids for the graduation groups are 
shown in Table 5. The centroids for the curriculnm groups are shown in Table 
6. 

Tables 5, and 6 about here 



DisGussion 



While the factor analysis was performed more for a reduction of items to 
constructs than as a confirmatory analysis, the results were similar to 
outconies which one might expect from prior research in postsecondary 
education. The findings tended to track the taxonomy proposed by Lenning 
(1977) except for the splitting of his category of the Social/Cultural/ 
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Personal Area into the three dimensions of Pefso lal Growth, Cultural 
Awareness, and Human Relations Skills. These findings, however, do not 
support Lenning's more refined four-digit taxonomy which has five dimensions 
and which groups items into two-digit subcategories within each dimension (a 
procedure similar to the structure of HEGIS). When one translates our 15 
items. into Lenning's four-digit category code numbers, we failed to obtain 
loadings on the f-otors which imply homogeneous items (e.g., items i:ith the 
same first two digits;. The failure to obtain factors which support the 
concept of homogeneous f^o-digit outcome codes is illustrated by several 
examples; While Lenning refers to 22XX as Competence and Skills, one of our- 
items in this category. Handle Various Situations, loaded on oar Personal 
Growth dimension. Our items on job skills, both part of Lenning's 22XX 
category, became a separate dimension. Our items on Leadership Aoility and 
Communication Skills (also in 22XX) loaded on the dimension of Human Relations 
Skills; Stated another way, we found at le-st three different dimensions 
which had loadings from items in the 22XX or Competence and '^kilis outcr:,,.;:^. 
Moreover, our item of Social Awareness, which appears similar to Perception of 
Others or 2430, loaded with our item of tippreciate Arts whici appears similar 
to Feelings and Er.iotions or 2330, to form the dimension of Ci Itural Awareness, 
rather than joining with the two items related to Perception of Self. These 
two items. Self Acceptance and Clai- 1 ficat ion of Values, loaded on the 
dimension of Personal Growth. 

The results also suggest cor. usiors one might de. -ve in consider it,?, the 
Clark and Trow ( 1 955 ) topoiogy: Th' ---sonal Growth dimension found in this 
research appears similar to the focb-: of the Nonconformist; do^ Skills is 
arialbgdus to the Vocational; Aoade-ic Skills ties 'o their Academic; and Human 
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Relatibns Skills co?responis to their Collegiate: The presence of such 
correspondence as found in the present study indirectly supports the Clark and 
Trow topology since ^^v.ir types could have caused the emergence of these 

ti 

dimensions; 

The dimensior- tdentxfied in this research as General Knowledge may have 
beer, misnamed by the researchers, for the loadings from "handle various 
situations" and from "communicate" imply the underlying construct was one of 
being prepared for the uncertainty one faces after leaving college. Since 
items written to reflect what might be called general ability were not 
included in this research, findings concerning a General Knowledge construct 
must await further research. 

The MANOVA analysis, among other unings, showeci a lack of significant 
interaction between Graduation Group and Curricula. The lack of significance 
suggests that the relative amount of the outcomes, as reflected in the nP.ior 
of students, remained stable over time. This findin, means that the 
difference in amount of an outcome received by one curriculum group relative 
to another curriculum group stays e3sentially the same over time. On the 
other hand it also means that the shifts in an outcome attributable to time 
occur proportionally to all groups. Three dimensions from the MANOVA explain 
the dispersion of groups based on their time of gradua^.ion. 

The first aimension. TI. relates to the applied nature of the outcome 
With the directly applicable outcomes of Human Relations Skills having a 
■ stronr: positive loading (.677) ana the broader less applied outcome of 
^ cultural Awareness having a hign negative weight (-.929). Within the 

W example if these groups we- ^ present and every one except the 
the items would be correlated and most likely emerge as a factor. 

o 10 
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Graduation Group, on this dimension, the means p. ogress steadily from a 
positive score for the earlier groups to a negative .T,ean for the most recent 
group (-.526 for Class of 1976). This result is extremely consistent with the 
shift of emphasis from that of a technical institute to that of a 
comprehensive university. 

The second dimension (Tii) is more difficult to interpret but seems to 
reflect the amount of interpersonal (Human Relations) skills one received 
relative to specific job skills. The -.03t reasonable explanation for the 
curvilinea-r shape of group means over time comes from attributing the dip in 
scores to societal emphasis on technology with the most negative score coming 
near the time of the successful Sputntk program (1957: and the emphasis on 
science and technology this space achievement causrj in the United States. 

The third dimension (Till) seems to relate to -e way in which one 
Handles challenges with a positive loading from Pe.^.o , - Growth (.996) to . 
negative loading on Human Relations Skills ^-.850): White it is not fully 
understood why two groups have positive means on this dimension, it is 
interesting to note the fact ^hat these two groups roughly coincide with the 
two major "polic° ^ictt ns" in Korea and Vietnam; 

In t.,.ms of curriculum Groups, the first function (CI) represents the 
relevance of the outcomes to job skills with that dimension having a negative 
weight (-.650) and Cultural Awareness having a positive Weight (.618); 
Business and Qualitative Studies, where one develops more general skills, have 
positive means while Engineering has a negative ..ean (-.520). The second 
function (CII) represents a contrast between the development of further skills 
(Academic: -.867) versus the direct movement into society (Human Relations:'. 
.5/(4). and differentiates between Business at the positive end (.280) and 

Applied Science at the negative end (-.143): 

1 1 
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should test this possibility by including additional items which woaid load on 
this dimension if it is present. 

It ippears that despite dire warnings by fcenning the outcomes of at least 
this institution have changed in a smooth continuous fashion over a span of 
forty years, a finding which implies a type of evolutionary behavior which may 
be of use in anticipating the future. Another finding is that different 
curricula produce different outcomes, an event which does not interact with 
year of graduation class and a fact which adds some support to the viewpoint 
that certain types of people self-select into specific career fields. 

A final point appears to be of importance for studying outcomes. Alumni 
seem to say that the outcome of their stay in the university has been 
rewarding and has influenced their careers and approaches to life. Regardless 
of the correctness of such a perception, studies on alumni may be of use 
simply to inform the management and fina-riciers of a university what alumni 
think of the results of a college education and to provide public relations 
materials to use with various publics. 



1 O 
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Table 1 



Varimax RotatedFactor Matrix 
for Sixteen Educationai Outcomes 



Outcomes 



Personal 
Growth 



Job 
Skills 



Cultural 
Awareness 



Gener ai 
Knowledge 



Acad emic 
Ski ' 1 s 



Human 

HvU atidns 
Skills 



B?iokffround for further 
ed uca tion 


.060 


.236 


. 100 


^.023 


.883* 


.002 


npnfiral knowiedce 


. 103 


. 185 


.238 


.857* 


-.063 


. 105 


^tz-i 1 1 for first lob 


.052 


.738* 


-. 195 


-.002 


.249 


.060 


Q ly -i 1 1 To r niirrpril" iob 


.084 


.809* 


.094 


. 166 


.037 


.019 


eiar ification of 
iite goais 


.475* 


.368 


.457 


.044 


.070 


.221 


Leaciersnip auixj-uy 


.293 


. 185 


.077 


-.040 


-.017 


.760* 


0(JCJ.a-L dWai 


. 140 


-.042 


.670* 


. 169 


124 


.417 


Personal development 


.303 


.055 


.351 


.094 


-.018 


.690* 


Relate to others 
sociaiiy 


.267 


-.037 


.331 


.064 


-.032 


.723* 


Appreciate arts 


. 169 


-.082 


.753* 


. 120 


.243 


.083 


Increased ambition 


.579* 


. 128 


. 126 


. 137 


.202 


.220 


Handle various 
situations 


.520* 


.026 


.090 


.428 


. 193 


.457 


Commun icate 


.324 


-.042 


-.021 


.377 


. 155 


.525* 


Self acceptance 


.697* 


-.030 


. 158 


. 128 


-.024 


.391 


Clarification of 
values 


.744* 


.043 


.358 


.022 


-.080 


.233 


Accept respKDhsibility 
for future 


.81 1* 


.098 


.032 


;05d 


.024 


.222 


*Used in the equation 


to develop a 


dimension 


score ; 
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Table n 

Standardized Discriminant Function Coefficients 
for Graduation Group and earriculum* 





Gradua tibri 


Group 


Curriculum 


Group 


Dimension 




TII 


Till 


CI 


CII 


Personal Growth 


.310 


.051 


.995 


-.217 


.002 


Job Skills 


.299 


-.252 


;326 


-.550 


.066 


Cultural Awareness 


-.929 


. 174 


.401 


.648 


-.582 


General Knowledge 


1^46 


.028 


. 142 


. 107 


-.046 


Academic Skills 


-.440 


.474 


-.491 


-.106 


-.867 


Human Relations Skills 


.677 


.723 


-.850 


.362 


.544 



*Aii functions are significant at p < .01 



Table 5 

Centroid Scores for Graduation Groups 
on Three 'Significant Functions 









Functions 




Graduat 


:ion Group 


TI 


TII 


Till 


Group 1 


(1931-1946) 


.352 


. 163 


= . 131 


Group 2 


(1951-1956) 


.269 


-.054 


. 148 


Group 3 


( 1 96 1 ) 


; mil 


-. 186 


-. 105 


Group M 


(1966-1971 ) 


-.239 


-.057 


-.075 


Group 5 


(1976) 


-.526 


. 144 


. 163 


F (13 


< .01 ) 


.82 


3. 00 


2.69 



1 (.] 
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Table 6 



CeritrbidScdres for Curricuiam Groups 
on Two Significant Functions 



Functidns 

Curriculum Group- Cl CXI 



Applied Science 
Business 



MO -.1^3 
.307 -280 



Qualitative Studies .273 -.068 

Engineering -.520 ^.059 

F (p <.01) 19. 7M ^' 5.58 



1 ^ 
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